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(57) ABSTRACT 

The present invention relates to an apparatus for rapidly 
analyzing frame(s) of digitized video data which may 
include objects of interest randomly distributed throughout 
the video data and wherein said objects are susceptible to 
detection, classification, and ultimately identification by 
filtering said video data for certain differentiable character- 
istics of said objects. The present invention may be practiced 
on pre-existing sequences of image data or may be inte- 
grated into an imaging device for real time, dynamic, object 
identification, classification, logging/counting, cataloging, 
retention (with links to stored bitmaps of said object), 
retrieval, and the like. The present invention readily lends 
itself to the problem of automatic and semi-automatic cata- 
loging of vast numbers of objects such as traffic control signs 
and utility poles disposed in myriad settings. When used in 
conjunction with navigational or positional inputs, such as 
GPS, an output from the inventive system indicates the 
identity of each object, calculates object location, classifies 
each object by type, extracts legible text appearing on a 
surface of the object (if any), and stores a visual represen- 
tation of the object in a form dictated by the end user/ 
operator of the system. The output lends itself to examina- 
tion and extraction of scene detail which cannot practically 
be successfully accomplished with just human viewers oper- 
ating video equipment, although human intervention can 
still be used to help judge and confirm a variety of classi- 
fications of certain instances and for types of identified 
objects. 



6 Claims, 8 Drawing Sheets 



vj/ 



-t 

o- 




07/01/2004, EAST Version: 1.4.1 



US 6,266,442 Bl 

Page 2 



OTHER PUBLICATIONS 

A Trainable Pedestrian Detection System, C. Papageorgiou, 
T. Evgenious, T. Poggio, Center for Biological And Com- 
putational Learning and Artificial Intelligence Laboratory, 
MIT, IEEE International Conference on Intelligent Vehicles, 
pp. 241-246, 1998. 

Robust Lane Recognition Embedded in a Real-Time Driver 
Assistance System, R. Risack, P. Klausmann, W. Kriiger, W. 
Enkelmann, Fraunhofer-Institut fur Informations, 
Karlsruhe, Germany, IEEE International Conference on 
Intelligent Vehicles, pp. 35^K), 1998. 
A Texture— based Object Detection and an Adaptive Model- 
based Classification, T. Kalinke, C. Tzomakas, W. Seelen, 
Institut fur Neuroinformatik, Bochum, Germany, IEEE 
International Conference on Intelligent Vehicles, pp. 
143-148, 1998. 

Internet Printout: The Road Sign Recognition System — RS 2 , 
Faculty of Transportation Sciences, Prague, Czech Republic, 
7 pgs., c. approximately 1999. 

Internet Printout: The Chamfer System, 4 pgs., c. approxi- 
mately 1999. 

Real-Time Object Recognition: Hierarchical Image Match- 
ing in a Parallel Virtual Machine Environment, J. You, P. 
Bhattacharya, S. Hungenahally, School of Computing and 
Information Technology, Griffith University, Brisbane, Aus- 
tralia, Dept. of Computer Engineering, University of 
Nebraska, Lincoln, Nebraska, 3 pgs., undated. 
An Architecture of Object Recognition System for Various 
Images Based on Multi-Agent, Keiji Yanai, Koichiro Degu- 
chi, Dept. of Computer Science, University of Electro-Com- 
munications, Tokyo, Japan, and Dept. of Mathematical 
Engineering and Information Physics, University of Tokyo, 
Tokyo, Japan, 4 pgs., undated. 

Multi-Feature Matching Algorithm for Free-Form 3D Sur- 
face Registration, C. Schutz, T. Jost, H, Hugli, Institute for 
Microtechnology, Neuchatel, Switzerland, 3 pgs., undated. 
Representation of Uncertainty in Spatial Target Tracking, 
Tim Baker, Malcolm Strens, DERA Farnborough, United 
Kingdom, 4 pgs., undated. 

Using Centroid Covariance in Target Recognition, Gang Liu 
and Robert M. Haralick, Dept. of Electrical Engineering, 
University ofWashington, Seattle, Washington, 4 pgs., 
undated. 

Using Spatial Sorting and Ranking in Model Based Object 
Recognition, G, Hjaltason, M. Ray, H. Samet, I. Weiss, 
Computer Science Dept. University of Maryland, College 
Park, Maryland, 3 pgs., undated. 

Surveillance Systems for Terrestrial Transport Safety and 
Improved User Information Capability, C. Nwagboso, C. 
Regazzoni, M. Renard, E. Stringa, Bolton Institute, Bolton, 
United Kingdom, Dept. of Biophysical & Electronic Engi- 
neering, Genova, Italy, Vigitec, Brussels, Belgium, pp. 1-7, 
undated. 



Landmark Recognition using Projection Learning for 
Mobile Robot Navigation, Ren C. Luo, Harsh Potlapalli, 
Center for Robotics and Intelligent Machines, IEEE World 
Congress on Computational Intelligence, vol. IV, pp. 
2703-2708, Jun. 1994. 

AReal-Time'Trafi^c Sip Recognition SystemrS. Estable, J. 
Schick,:F;:Stein f R. Janssen, R. Ott, W. Ritter, Y.-J. "Zheng, 
/Daimler-Benz Research Center, Proceedings of the Intelli- 

/ gent Vehicles^94_Symposium,-Paris,,Erance,„pp.. 213-^21 8, 

1 OcXl994T 

Recognition of Tfaffic'Signs by AriificialNeuralNetwork, D. 

Ghica^Sr-LXiTXrYuanf Depf . of Computer Science Memorial 
r University of -Newfoundland,_IEEE,^pp.-1444-1449^ Mar. 
"21995.— ~ 

Realtime Traffic~Sign~Recognition (TSRJ, Jens Logemann, 
Edi, Univeritat Koblenz-Landau, 3 pgs., Nov. 1997. 

,_r^__ . . — — — — / 

Registering Multiple Cartographic Models with the Hierar- 
chical Mixture of Experts Algorithm, Simon Moss and 
Edwin R. Hancock, Dept. of Computer Science, University 
of New York, IEEE, pp. 909-914, 1997. 

Multi-Modal Tracking of Faces for Video Communications, 
James L. Crowley and Francois Berard, GRAVIR — IMAG, 
I.N.P. Grenoble, Grenoble, France, IEEE, pp. 640-645, 
1997. 

Road Traffic Sign Detection and Classification, A. Escalera, 
L. Moreno, M. S aliens, J. Armingol, IEEE Transactions on 
Industrial Electronics, vol. 44, No. 6, pp. 848-859, Dec. 
1997. 

Auto-associative Segmentation for Real-Time Object Rec- 
ognition in Realistic Outdoor Images, Leonardo Estevez and 
Nasser Kehtarnavaz, Dept. of Electricial Engineering, Texas 
A&M University, Journal of Electronic Imaging, vol. 72, pp. 
378-385, Apr. 1998. 

Mandal, "Illumination Invariant Image Indexing Using 
Moments and Wavelets" Journal of Electronic Imaging, Apr. 
1998 pp. 282-293, vol.7 (2), USA. 

Celentano, "Feature Integration and Relevance Feedback 
Analysis in Image Similarity Evaluation" Journal of Elec- 
tronic Imaging, Apr. 1998, pp. 308-317 vol. 7(2), USA. 

Estevez, Auto-Associatve Segmentation for Real-Time 
Object Recognition in Realistic Outdoor Images, Journal of 
Electronic Imaging, Apr., 1998 pp. 378-385 vol. 7(2), USA. 

* cited by examiner 



07/01/2004, EAST Version: 1.4.1 



